Beyond the Significance Test Ritual What Is There ?
نویسندگان
چکیده
The mindless use of null-hypothesis significance testing – the significance test ritual (e.g., Salsburg, 1985) – has long been criticized. The main component of the ritual can be characterized as follows: Once you have collected your data, try to refute your null hypothesis (e.g., no mean difference, zero correlation, etc.) in an automatized manner. Often the ritual is complemented by the “star procedure”: If p < .05, assign one star to your results (*), if p < .01 give two stars (**), and if p < .001 you have earned yourself three stars (***). If you have obtained at least one star, the ritual has been successfully performed; if not, your results are not worth much. The stars, or the corresponding numerical values, have been door-openers to prestigious psychology journals and, therefore, the ritual has received strong reinforcement. The ritual does not have a firm theoretical grounding; it seems to have arisen as a badly understood hybrid mixture of the approaches of Ronald A. Fisher, Jerzy Neyman, Egon S. Pearson, and (at least in some variations of the ritual) Thomas Bayes (see Acree, 1979; Gigerenzer & Murray, 1987; Spielman, 1974). For quite some time, there has been controversy over its usefulness. The debates arising from this controversy, however, have not been limited to discussions about the mindless procedure as sketched above, but have expanded to include the issues of experimental design and sampling procedures, assumptions about the size of population effects (leading to the specification of an alternative hypothesis), deliberations about statistical power before the data are collected, and decisions about Type I and Type II errors. There have been several such debates and the controversy is ongoing (for a summary see Balluerka, Gómez, & Hidalgo, 2005; Nickerson, 2000; Sedlmeier, 1999, Appendix C). Although there have been voices that argue for a ban on significance testing (e.g., Hunter, 1997), authors usually conclude that significance tests, if conducted properly, probably have some value (or at least do no harm) but should be complemented (or replaced) by other more informative ways of analyzing data (e.g., Abelson, 1995; Cohen, 1994; Howard, Maxwell, & Fleming, 2000; Loftus, 1993; Nickerson, 2000; Sedlmeier, 1996; Wilkinson & Task Force on Statistical Inference, 1999). Alternative data-analysis techniques have been wellknown among methodologists for decades but this knowledge, mainly collected in methods journals, seems to have had little impact on the practice of researchers to date. I see two main reasons for this unsatisfactory state of affairs. First, it appears that there is still a fair amount of misunderstanding about what the results of significance tests really mean (e.g., Gordon, 2001; Haller & Krauss, 2002; Mittag & Thompson, 2000; Monterde-i-Bort, Pascual Llobell, & Frias-Navarro, 2008). Second, although alternatives have been briefly mentioned in widely received summary articles (such as Wilkinson & Task Force on Statistical Inference, 1999), they have rarely been presented in a nontechnical and detailed manner to a nonspecialized audience. Thus, researchers might, in principle, be willing to change how they analyze data but the effort needed to learn about alternative methods might just be regarded as too great. The main aim of this special issue is to introduce a collection of these alternative data-analysis methods in a nontechnical way, described by experts in the field. Before introducing the contents of the special issue, I will briefly outline the ideal state of affairs in inference statistics and discuss the difference between mindless and mindful significance testing.
منابع مشابه
Iranian Women, Inside or Outside of the Stadium? An Anthropological Study on Female Representation of National Identity in Iran
A controversial and comprehensive debate that has resulted in numerous discursive clashes in Iran pertains to the presence of women at stadiums during male soccer matches. Different discourse systems have expressed their own contradictory and opposite stances in terms of whether Iranian women have the right to attend such events inside or outside the stadium, ranging from different notions of r...
متن کاملThe inquiry to identify the cultural contex of architecture from Nefar to Saqa-Nefar
The Saqa-Nefar are specific architecture of Mazandaran province, and the origin of their formation are date to ritual traditions of pre-Islamic periods. Currently, those are known as architecture of Ashura that are in order to protect the sanctity of water and attributed to Aboulfazl (AS). Their architecture is combination of architecture combination with semantic components in format of motifs...
متن کاملThe effects of emotion on tip-of-the-tongue states.
Tip-of-the-tongue states (TOTs) are judgments of the likelihood of imminent retrieval for items currently not recalled. In the present study, the relation of emotion to the experience of TOTs is explored. Emotion-inducing questions (e.g., "What is the term for ritual suicide in Japan?") were embedded among neutral questions (e.g., "What is the capital of Denmark?"). Participants attempted to re...
متن کاملFraming the Health Workforce Agenda Beyond Economic Growth
The fourth Global Forum on Human Resources (HRH) for Health was held in Ireland November 2017. Its Dublin declaration mentions that strategic investments in the health workforce could contribute to sustainable and inclusive growth and are an imperative to shared prosperity. What is remarkable about the investment frame for health workforce development is that there is little debate about the ty...
متن کاملThe Architectural Context of Caches , Burials , and Other Ritual Activities for the Classic Period
W hat goes inside a Maya building is just as signif icant in determining its function as a building's architectural plan and external appearance. Structures are not alike in their contents. Some hold in-terments and caches; some contain earlier buildings; others are single or multiple construction efforts with no contents other than f ill. Artifacts are found littered on the f loors of some bui...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009